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Abstract. We obtain an explicit characterization of the stable points of the action of G = 
SL{2,C) on the cartesian product G^" by simultaneous conjugation on each factor, in terms 
of the corresponding invariant functions, and derive from it a simple criterion for irreducibility 
of representations of finitely generated groups into G. We also obtain analogous results for the 
action of SL{2, C) on the vector space of n-tuples of 2 x 2 complex matrices. For a free group F„ 
of rank n, we show how to generically reconstruct the 2"~^ conjugacy classes of representations 
F„ ^ G from their values under the map T„ : G^" = Hom{Fn, G) — > C'^""'^ considered in ImI . 
defined by certain 3n — 3 traces of words of length one and two. 



1. Introduction and main results 

Representation varieties and character varieties of finitely generated groups have been exten- 
sively studied in the last three decades, not only for their many interesting properties, but also 
in relation to subjects such as knot theory and spectral geometry of hyperbolic manifolds, among 
several others (see for example |CS[ IGoL IhI Im] and references therein) . 

Here, we mainly concentrate on two problems related to the variety of conjugacy classes of 
representations of finitely generated groups into G = SL(2,C), and particularly the case of rep- 
resentations of a free group. The first is the characterization of the stable points (in the sense of 
geometric invariant theory) of the action of G on the cartesian product G^" under simultaneous 
conjugation, in terms of the corresponding invariant functions. As a consequence, we obtain a 
simple numerical condition for the irreducibility of representations of finitely generated groups. 
The second is a detailed study of a map considered by Magnus jMj, following earlier work by Vogt 
[V] and Fricke and Klein |FKj. which is related to the question of finding a minimal number of 
invariant functions on G^" required to get all the other invariants by algebraic extensions. 

We now describe the main results. Let G be the algebraic Lie group SL{2,C) and, for a fixed 
integer rt > 1, let Xn denote the cartesian product G^". We are interested in the orbit space of 
the action of G on the affine variety X„ under simultaneous conjugation on every factor. This is 
equivalent to the space of conjugacy classes of SL{2, C) representations p : ^ G of a free group 
Fn on n elements, since 

HomiFn,G)^Xn 

by fixing a choice of generators of F„. 

In the context of algebraic geometry, we can consider the affine quotient Xn//G, whose coordinate 
ring is the ring C[X„]'^ of regular functions on Xn that are invariant under the action of G. This 
is a categorical quotient where the geometric points parametrize closed orbits. It is a consequence 
of a very general result, the first fundamental theorem of invariants of to x m matrices (see jPj 
for TO > 2, or Thm. 12 .11 below for m — 2), that the building blocks of these G-invariant functions 
are the following trace functions. To any given word w £ Fn, the corresponding trace function t„ 
(sometimes called Fricke character) is the algebraic G-invariant function 

(1.1) : Hom{Fn,G) C 

that sends a representation p to the trace of the SL{2,C) matrix p{w). Moreover, it is a very old 
result of Vogt and Fricke (see and also ^) that the ring of these trace functions is finitely 
generated. One of these finiteness results is as follows. Let ei, e„ S F„ denote a fixed choice of 
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generators of F„ and define the subset of F„ consisting of the lexicographically ordered words of 
length < 3 with no repeated letters 

Hn = {ej, l<j<n}U {ejEfc, 1 < j < fc < n} U {€j€kei, I < j < k < I < n) <Z Fr,, 

of cardinality TV = n + (^) + (;;) = i^-^. One can show that given any word w € F„, the function 
tu, is a polynomial with rational coefficients in the variables tj, £ Hn (see p^, Cor. 4.14). These 
generators give an embedding of the categorical quotient in C^, so that Xn//G corresponds to 
some polynomial ideal in C[t-y, -f £ iJ„]. 

In the present paper, inspired by geometric invariant theory (GIT), we obtain a simple criterion, 
in terms of trace functions Hl.l|l . for an element A S X„ to be in the subset of X„ = G^" of 
stable points for the action of G. By standard arguments of GIT, the affine stable quotient /G 
will be an affine variety which is a geometric quotient of X^ by G in the sense that all fibers of the 
quotient map are indeed orbits of the action. This is in contrast to the categorical affine quotient 
Xn//G where the points only parametrize closure-equivalence classes of orbits. 

In another direction, we show that a similar numerical criterion can be used to check the 
irreducibility of a representation of a finitely generated group F in G = 5*^(2, C), as follows. Let 
ei, in be a choice of generators of F. If p : F — > G is a representation, define A € X„ by setting 

A = (p(ei), ...,p(e„)). 

On the other hand, a given point A — {Ai, ...,An) G X„ produces a representation p of the free 
group Fn, by letting p{ej) = Aj for j — l,...,n. For three indices ^ < j,k,l < n, denote by 
Pjki ■ G the representation associated to {p{ej), p{ik), p{ii)) S ^3. In section 4, we show. 

Theorem 1.1. For a representation p :T G, the following sentences are equivalent, 
(i) p : T ^ G is reducible. 

(a) (p(ei), ...,p(e„)) e Xn is not stable for the conjugation action of G. 

(Hi) There is a g £ S'i(2,C) such that all matrices gp{ek)g^^ are upper triangular. 

(iv) For all triples of indices 1 < j,k,l < n, pjki : F3 ^ G is reducible. 

In |CS| (Cor. 1.2.2), Culler and Shalen proved that p : F ^ G is reducible if and only if tr(/i) = 2 
for every element h in the commutator subgroup [F,F]. Part (iv) of Theorem 11.11 shows that 
irreducibility can be decided by a finite process, looking only at all the associated representations 
of F3. Furthermore, the analysis of irreducibility for the case of F3 leads to the following concrete 
numerical condition. For each triple of indices I < j,k,l < n, define the following G invariant 
functions (Tjk,Ajki : Xn C (see also definition 12.41 belowl . 

ajk{A) = tr{[Aj,Ak])-2, 

(1.2) ^3ki{A) = itr{AjAkAi)~tr{AiAkA,)f, 

where [Aj,v4fe] — AjAkAj^A^^ is the commutator of SL{2,C) matrices. The function Ajki may 
be called the Fricke discriminant, being the discriminant of the polynomial associated to the Fricke 
relation (see |Go|Im] 1. We prove 

Theorem 1.2. Let A = {Ai, An) G Xn be the n-tuple associated with the representation p : 
F — + G. Then p is reducible if and only if <7jk (A) = Ajki {A) = for any triple 1 < j,k,l < n. 

The computations involved in the theorems above can be easily adapted for the case of SL(2, C) 
acting by simultaneous conjugation on the vector space Vn of n-tuples of arbitrary complex 2x2 
matrices. In section 3, after briefly recalling the relevant definitions in geometric invariant theory, 
we describe the stable locus for this bigger space, and prove results analogous to the above theorem 
(see Theorem I3.3|l . All these results are based on the explicit characterization of the n-tuples of 
2x2 matrices that are simultaneously similar to a set of n upper triangular matrices, in terms of 
invariant functions, which is obtained in section 2 (see Theorem 12. 7|l . In section 4, we also briefly 
comment on the relation between this notion of stability and the stability of the holomorphic vector 
bundle on a compact Riemann surface S arising from a representation of the fundamental group 
of S into G (see Proposition 14. 4|l . 
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Section 5 focus on the problem of reconstructing an orbit of the action of G on X„ from a minimal 
number of traces, which was motivated by the articles (Mj and |Go| . Consider an arbitrary finite 
sequence of words J = (wi, wjy) G (Fn)^ and let Tj denote the map 

Tj ■.X,, = Hom{F,„G) -> 

(1-3) p ^ {t^,{p),...,t^^{p)). 

Given that the quotient G^'^//G is a variety of dimension 3n — 3, and Tj factors through this 
quotient, it is natural to look for a sequence J of = 3n — 3 words, such that Tj is surjective onto 
a Zariski open subset of C'^""'^ and that all the preimages are finite (when non empty). Under 
the algebra-geometry dictionary, this is equivalent to finding a minimal set of trace functions 
tujj, such that the field of invariant rational functions on G^" is an algebraic extension of 

; ■ • ■ ; ^u;jv ) • 

In this paper, we consider only those sequences J composed of the n basic trace functions of 
length one id , te„ and some choice of 2n — 3 other words of length 2. The basic example is the 
result attributed to Vogt and Fricke that, for n = 2, the map 

is surjective. In |Go| . Goldman presents an almost self-contained proof of this, showing also that 
for n = 3, the trace map 

(ei,e2,e3,ei«2,ei«3,e2C3) ' ^3 ^ 

is again surjective. To consider the case of a free group of arbitrary rank n > 4, first note that 
we cannot take as J the sequence with the n words of length one together with the (2) ordered 
words of length two, since this would have length greater than the wanted 3n — 3. Let us choose 
the sequence of length 3n — 3 omitting those words of length two ejtk such that {j, fc} n {1, 2} = 0, 



(1-4) J„ := (ei, £2, eie2, efc, eiCfc, e2efc, £«, ^i^m ^2^n), 

and denote the corresponding trace map by T„ = Tj^ . Of course, it would be completely analogous 
to use another sequence of the form (11.411 with another pair of indices playing the role of {1, 2}. In 
terms of the n-tuple A = {Ai, A„) e G^" corresponding to p : F„ ^ G we have 

(1-5) Tn{A) = (fl, <2, ^12, tk, tlk,'t2k, t-n, tin, t2n) , 

where we use the notation tj ^ tr{Aj), tjk = tr{AjAk)- In section 5, we show that r„ is almost 
surjective for n > 4, and omits a set contained in a very expHcit irreducible subvariety of C'^""'^ of 
codimension 1. Examples of points z S C'^""'^, with T~^{z) empty are given in the Appendix. 

The algebraic map T„ : Xn C'^"^'^ H1.5|l will be called the Magnus trace map. In [M], Magnus 
showed that, given three matrices A\,Ai and ^3 verifying 0-12(^1, A2) ^ and Ai23(^i, A2, ^3) 7^ 
and given any q g C'^"~^ (thought as the last 3n— 9 coordinates in C^""'^) one can find n— 3 other 
matrices ^4, A„ such that r„( A) = (p, q), where p = (ii, ^2, ^12, ^3, ^13, ^23)- He also proved that 
the number of different solutions {A^, ^n) realizing this equation is bounded by 2"~^. It turns 
out that the Fricke discriminant condition A123 is not really necessary, and we only need 
to impose the condition 0-12(^1,^2) 7^ to be able to find A3, A„ such that tr(Afc), \.x{AxAk) 
and Xxi^AiA-k) assume preassigned values for fc = 3, Moreover, the condition tTi2(Ai, ^2) 7^ 

allows us to express the (at most 2"~^) orbits in the preimage of T„ in very explicit terms. 

Theorem 1.3. Let Bi,B2 e SL{2,C) be such that tr{[Bi,B2]) ^ 2. Then, there exists a g & G 
such that Aj := gBjg^^ , j = 1,2 are invariant under transposition. Let n > 3 and r = (ti,t2jii2)- 
Then, given any s e C^n-e ^/jg^g gxist n — 2 matrices A3, An e SL{2, C) such that 

(1.6) r„(A) = (r,s). 

Moreover, given any solution A G Xn of fl.fJp with tr{[Ai, A2]) ^ 2 and Af = Ai and = A2 
(where T denotes transposition) the inverse image Tn^{Y,s) consists of the G orbits of the finite 
set 

{{Ai,A2,B-i,...,Bn) ■ Bj = Aj orBj = Aj for j = 3, . 
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2. Degenerate simultaneous similarity of 2 x 2 matrices 

In this section, we are interested in the simultaneous conjugacy classes of a finite set of 2 x 2 
complex matrices. We will describe the most degenerate cases, in particular give necessary and 
sufficient conditions, in terms of invariant functions, for n matrices to be simultaneously conjugated 
to matrices in upper or lower triangular form. 

Let the general Hnear group GL{2, C) act on the vector space of n-tuples of 2 x 2 matrices 
(n > 1) 

Vn (Af2x2(C))"" 

by simultaneous conjugation 

(2.1) g-A:= {gAig-\...,gA,,g-^), 

where A = {Ai, An) € Vn and g £ GL{2,C). There are plenty of GL(2, C)-invariant regular 
(i.e, polynomial) functions on Vn and, by the first fundamental theorem of invariants of m x m 
matrices jPj, the trace functions defined by 

K->C, A^tr{A,,---A,J 

and labelled by 'words' Ai^ ■ ■ ■ Ai^ in the components Aj of ^ € y„, generate the ring of invariants 
C[y^]GL(2,C)^ Moreover, this ring is finitely generated and we have 

Theorem 2.1. (Procesi p;) Any GL{2,€.) -invariant regular function on Vn is a polynomial in 
the following set of {n + 1)^ functions 

A^tr{AjAkAi), 0<j,k,l<n, 

where A — (Ai, ...,yl„) e Vn and Aq — I is the identity 2x2 matrix. 

The many relations between these functions, described by the second fundamental theorem of 
invariants of matrices (see jPj), will not be important here. 

As in the case n = 1, two elements A and A' of Vn will be called similar if they are in the same 
GL{2, C) orbit. Note that an element A £Vn can be viewed either as a vector of 2 x 2 matrices as 
above or, alternatively, as a single matrix with vector valued entries 

(2.2) A^( ^ 5 V a,6,c,(ie C". 



c d 

This justifies the following terminology and notation. 

Definition 2.2. A point A = {Ai, ...,An) S Vi will be called an n-matrix. We will say that A is 
an upper triangular n-matrix if the vector c G C" is zero, and we will denote by UTn C Vn the 
GL{2, C) orbit of the subset of upper triangular n-matrices. Hence, A g UTn if and only if A is 
similar to an upper triangular rt-matrix. Aj is called the jth component of A. 

Note that A is similar to an upper triangular rt-matrix if and only if there is a proper nonzero 
subspace of which is fixed by every component Aj of A. The condition A G UTn is also 
equivalent to A being similar to a lower triangular n-matrix (one with zero 6 G C"). 

The similarity classes of a pair of m x m matrices were obtained in [^, and in the simplest 
TO = 2, n = 2 case, the following irreducible algebraic subset of V2 plays an important role 

(2.3) W^l (Ai, A2) G V2 : (til - fl){t22 - = L2 - \t^t2 
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Here and below, we are using the following notation 

tj := tr(Aj) 
tjk := tr(AjAk) 

for a general element A — {Ai, An) G Vn and any pair of indices j, k e {1, n}. The relevance 
of W can be seen from the fact that if (Ai, A2) does not belong to W, then its GL{2, C) orbit is 
uniquely determined by ti, ^2, in, ^22, ^12 (E)- Moreover, the following is not difficult to prove. 

Proposition 2.3. (see, for instance, ^j) A pair {Ai,A2) G V2 belongs to W if and only if it is 
in the orbit of a pair of upper triangular matrices. 

To generalize this result to higher n, let us abbreviate some frequently used GL{2, C)-invariant 
functions on Vn as follows 

Definition 2.4. Define, for every triple of indices 1 < j, k,l < n, 

_ 1 

Tjk tjk — 2^jtk: 

(Jjk Tff.-TjjTkk, 
Ajkl ■— {tjkl ~ tlkjT ■ 

We omit the dependence on A = [Ai, An) where no ambiguity arises. For A e Vn and g £ 
GL{2, C), we will always write 

or sometimes Aj — [aj, bj, Cj, dj), g — (x, y, z, w). In terms of these variables and of Cj :— Uj — dj, 
we have: 

e ' Gk 

Tjk = + bjCk + Cjbk, 

(2.4) ajk = {bjCk - Cjbk)^ - (bjCk ~ ejbk){cjek - ejCk). 
We also use the abbreviation 

1 2 e| 
'^ij = ^j'j ^ 2^3 ~ ~2 ^^j'^J' 

so that i^j 7^ if and only if Aj has distinct eigenvalues. The functions ajk and Ajki are fully 
symmetric under index permutation and vanish whenever two indices coincide. Note that —a-jk 
and — ^Ajki are, respectively, the top left 2x2 minor and the determinant of the symmetric matrix 

/ Tjj Tjk Tjl \ 

(2.5) Tkj Tkk Tkl 

\ Tlj Tlk Til J 

With slightly different normalizations, the restrictions of these functions to S'L(2,C)^"' were 
used in |(tM| and [M]. Since the equation Ij2.8ll that defines C V2 is ai2 — 0, the condition 
ajk{A) = for some j, fc G {1, n} is equivalent to (Aj,Ak) G UT2, by ProDosition l2.^il Therefore, 
we have 

Proposition 2.5. If A £ Vn is similar to an upper triangular n-matrix, then ajk{A) = for all 
distinct 1 < j,k < n. 

Proof. If ^ = {Ai, An) £ UTn then 51 • A is upper triangular, for some g G G. Hence, g ■ {Aj, Ak) 
is an upper triangular 2-matrix, for any ^ < j, k < n, and ajk = by Proposition [231 ^ 

For n >2, define, for distinct j, k € {1, n}, the following algebraic subsets of Vn 

W,k = Wkj := {AeVn-. ajkiA) = 0}, 

E„ ■■=f]Wjk. 

j,k 
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Then, A e S„ if and only if every pair of matrix components of A is in From Proposition 

12.51 we have 

UTn C S„ C Vn 

for all n > 2. However, the vanishing of all ajk is not sufficient for A to be in UTn, for n > 3, as 
the next example shows. 

Example 2.6. Let ^ = (v4i, ^2, ^3) be defined by 



Then 0-12 — cria = and 0-23 = ^223(6263 + 6203). Assume that 6263 + 6203 — and that 6162C3 ^ 0, 
so that all ajk vanish, neither A2 or ^3 are diagonal, and (since these assumptions imply 6263 7^ 0) 
all three matrices have distinct eigenvalues. Let g = {x,y,z,w) £ SL{2,C). Then 



(2.6) 5^25"' 
5^35"^ 



zwei * 

* x(a;62 - 2/62) 
z(u;62 — 2:62) * 

* ~y{xe3 + 2/C3) 
w(ze3 + WC3) * 

from which it follows that A is not similar to an upper triangular 3-matrix. 



On the other hand, we have. 

Theorem 2.7. Let n> 1. A = (Ai, A,i) G Vn is similar to an upper triangular matrix if and 
only if for all triples 1 < j,k,l < n, {Aj, Ak, Ai) is similar to an upper triangular 3-matrix. 

For the proof, we will use the following lemmata. 

Lemma 2.8. Let A be an upper triangular n-matrix with i^j — ^ ^ 0, for some 1 < j < n. Then, 
A is similar to another upper triangular n-matrix A' ~ (A'j^, ...,A!^ with A'^ diagonal. 

Proof. We only need to find g G GL(2,C) such that gAkg~^ is still upper triangular for any 
k, and such that gAjg~^ is diagonal. Letting g = {x,y,0,x~^) for some a; 7^ 0, we calculate 
gAkg~^ — {ak,bkX^ — yxek,0,dk), ior every k = Therefore, all gAkg~^ are upper triangular 

matrices, and using y — bjx/cj (since Cj 7^ 0), gAjg^^ is diagonal. □ 

Lemma 2.9. As in Examvle \2.f>[ let A — (Ai, A2, A^) be a triple of the form 

^-(o- :)■ --("0 1)^ : 

Then A e UT3 if and only if 6162C3 — 0. 

Proof. If 6162C3 = at least one of the factors is zero. In each case, Ai is a scalar, A is lower 
triangular, or A is upper triangular, respectively, so A G l^Ts- Conversely, suppose that 6162C3 7^ 0. 
Then, from equations (12.611 we see that there is no g S G that will make g ■ A upper or lower 
triangular, so A ^ UT3. □ 

We can now finish the proof of Theorem 12. 71 

Proof. The Theorem is obvious for n < 3, so let 71 > 4. If A £ Vn is similar to an upper triangular 
n-matrix, then obviously any m-tuple {Aj-^, ...,Aj^) of to < n components of A will be in lATm- 
Conversely, let all triples of components be in UT^ and suppose, by induction, that the result is 
valid for n—1. Then, in particular, all the ajk and all /S.jki are zero, for indices j, k, I between 1 and 
n — 1. To reach a contradiction, assume that A is not similar to an upper triangular rt-matrix. By 
induction, we can suppose that (Ai, A„_i) has been conjugated so that it is already an upper 
triangular [n ~ l)-matrix. Let An — {an,bn, Cn, dn) with c„ 7^ 0. None of the Aj can be central, 
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otherwise the result would follow by induction. The n — 1 conditions (Tj„ — 0, j ~ 1, n — 1 imply 
(because c„ ^ 0) 

(2.8) b'^Cn + bjCjen — e'^bn = 0, for j = 1, rt — 1. 

If one of the Cj, j = 1, ...,n—l vanishes then, since Aj is non-scalar, bj ^ and the equations Ij2.8|l 
become 6|c„ = and have no solution. As a consequence, none of these e^'s can be zero. Then, by 
lemma|2iHl one can assume that b\ = 0, and the equation 112.811 with j = 1 implies 6„ = 0. Now, we 
have all triples (Ai,y4fe,^„), with k = 2,...,n— 1, in the form (I2.7|l . Since {A\, A-^, An) G WT3 by 
hypothesis, lemma l2^ implies eibkCn = 0. So, bk = for all fc = 2, ...,n— 1. But then {Ai, A„) 
is lower triangular, and we have a contradiction. □ 

Note that the Theorem is true for any algebraically closed field of characteristic in place of 
the field of complex numbers. The following statement is also useful. 

Lemma 2.10. Let A ~ {Ai, A2, ^3) G S3 \ UT^. Then, A is similar to a triple of the form \2.1l]) 
with 6263 + 62C3 — and 616203 ^ 0. 

Proof. Assume that A g E3. In particular, G12 = 0, so we can suppose that Ax and A2 are both 
upper triangular. Let A^ = (03, 63, C3, ^3). Since A ^ UT^, none of the Aj can be a scalar, and C3 
is nonzero. The 2 conditions 17^3 = 0, j = 1, 2 imply (because C3 7^ 0) 

(2.9) b]cz + 6^6^63 - 6^63 = 0, for j = 1, 2. 

If one of the Cj, j — 1,2 vanishes then, since Aj is non-scalar, bj ^ and the equations Ij2.9ll 
become 6|c3 = and have no solution. So, necessarily 6162 7^ 0. Then, by lemma 12781 one can 
assume that 61 = 0, and the equation (12.911 with j = I implies 63 = 0. Since A cannot be lower 
triangular, we need to have 62 7^ 0, and Ij2.9ll for j = 2 simplifies to 62C3 + 6263 = 0. □ 

Corollary 2.11. (^1,^2, ^3) G V3 is similar to an upper triangular 3-matrix if and only if 

0'12 = 0-13 = (723 = A123 = 0. 

Proof. If A G UT^, then ajk — for all j, fc, by Proposition 12.51 and by direct computation 
^123 = ^321- Conversely, if all ajk — and A ^ by lemma l2.10l we can suppose that A is in the 

form Ij2.7|l with ei&2C3 7^ 0. An easy calculation then gives A123 = (^123 — ^321)^ = 6162^3 7^ 0. □ 



This Corollary extends to all 2 x 2 matrices the result stated in Prop. 4.4 of |GM| for triples of 
SL{2,C) matrices. The following Proposition will be useful later. 

Proposition 2.12. Let A be a 2-matrix with (T12 7^ 0. Then A is similar to a 2-matrix B invariant 
under simultaneous transposition (Bf = Bi and i?J = B2). 

Proof. We consider first the case when at least one of the matrices Ai or A2 is diagonalizable. 
Without loss of generality let Ai be diagonal and A2 = (02,62,62,^2)- Then au = —e\b2C2 
from H2.4|l . Conjugation of A by the diagonal matrix g = (x, 0, 0, a;"^) produces the assignment 
62 ^ b2X^, C2 1-^ C2X~^ and so, we just solve 62^^ = 622;"^ for an appropriate x ^ 0, which is 
possible since (T12 7^ 0. Now, consider the case I'l = 1^2 = 0. Assuming that Ai is already in Jordan 
canonical form, write A — (^1, yl2) as 

(2.10) A,^(^^ ^V A2 



fll y ' \ C2 ^2 

with 5iC2 7^ according to the hypothesis (T12 7^ 0. Suppose first that 62 = 0, which implies 
^2 — 0'2, since 1/2 = 0. Conjugating {Ai, A2) by a diagonal matrix as before, we can further assume 
that bi = C2. Then, using 



and we obtain explicitly the transposition invariant pair, 

. , ai + A i\ \ . / 02 - A i\ 
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with 6i = C2 = 2i\. Finally, if 62 7^ in H2.1()|l . using the equation 1^2 — + 262C2 ~ 0, which 
implies 62 7^ 0, it is a simple computation to show that conjugation hy g — (x, 1, 0, x^^) with 
X = ^ reduces that pair to one with Ai upper and A2 lower triangular. Note that in both cases, 
the transposition invariant 2-matrix B verifies (T12 — —eib"^ — IGX^. □ 

3. Stability of the SL{2,C) action on 2 x 2 matrices 

In this section, we determine, in terms of invariant functions, the stable points of the action 
of SL(2, C) on the vector space Vn of n-tuples of complex 2 x 2-matrices, under simultaneous 
conjugation on each factor. 

Recall that, in the general situation of a general algebraic linearly reductive Lie group K acting 
on an afHne variety V one defines the affine quotient variety V// K as the spectrum of the ring of 
invariant functions on V, which comes equipped with a projection 

q:V ^ V//K 

induced from the canonical inclusion of algebras C[l/] C C[l^]^. The set of closed orbits is in 
bijective correspondence with geometric points of the quotient V//K. Recall also that a vector 
X IS, said to be stable if the corresponding map 

iix-K^V, g-x 

is proper. It is easy to see that x € V \s stable if and only if the closure of the i^T-orbit of x 
does not intersect the closed subset consisting of points x €V with positive dimensional stabiHzer 
subgroup. Another useful criterion for stability is the Hilbert-Mumford numerical criterion, which 
is stated in terms of nontrivial homomorphisms : C* — > if, called one parameter subgroups (IPS) 
of K. To any such (j) and to a point x & V one associates the morphism (j)^ : C* ^ V given by 
mapping A S C* to the point (j){X) ■ x. If (j)x can be extended to a morphism (j)^ : C ^ V , we say 
that limA^o 4>x exists and equals 4>xiO)- 

Theorem 3.1. (Hilbert-Mumford |MFK| . see also jHIl) ^ point x £ V is stable if and only for 
every one parameter subgroup 4> of K , (p^ cannot be extended to a morphism C ^V. 

It is easy to see that the conjugation action of GL(2, C) on the space of n-tuples of 2 x 2 matrices 
Vn has no stable points, since the scalar nonzero matrices will stabilize any point A G Vn- This 
is not a big problem, since the same orbit space can be obtained with the conjugation action 
of G = SL{2,C) on Vn which has generically finite stabilizers. This is just the restriction to 
G C GL(2,C) of the action 112.111 . One could as well consider the action of PSL(2,C) which 
would have generically trivial stabilizers, but we will keep using G = SL{2, C). It is clear that any 
diagonal n-matrix A (one for which both vectors b and c in 112. 2|l are zero) has the subgroup 

(3.1) ^ = ( x-^)^G,\££* 

contained in its stabilizer. The following is then an easy application of the Hilbert-Mumford 
criterion. Theorem 13. II 

Proposition 3.2. A EVn is stable if and only if A is not similar to an upper triangular n-matrix. 

Proof. If A is an upper triangular n-matrix, a simple computation shows that the closure of the 
orbit of A under the subgroup H C G H3.1|l will intersect D. Therefore, no point in the orbit 
of A will be stable. Conversely, let A & Vn he not stable and apply the numerical criterion. By 
elementary representation theory, any one parameter subgroup of G is conjugated to 

A 1-^ 0„(A) = ^0 A^" ) ' " ^ ^0- 
In other words, any IPS can be written as (f) = g^^(j)ng, for some g £ G and some 0„ so, 

(3.2) Uni 0(A) ■A = g-^ lim 0,(A) ■ (g ■ A). 
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Writing g ■ A as 

g-A = 

we obtain 

0„(A)-(g-A) = 



a-ig) b{g) 
c{g) d{g) 



a{g) 6(g)A2" 
c(5)A-2" d{g) 

By the Hilbert-Mumford criterion, the Umit H3.2|l exists for some IPS, so we must have c{g) = 0, 
for some g & G. This means that g ■ A is an upper triangular n-matrix. □ 



Note that this result can be easily generalized to describe the stable points of the action of 
SL{m, C) under simultaneous conjugation on the vector space of n-tuples of m x to matrices. To 
summarize, for the action of S'L(2,C) on 14, we have shown the following, which is a consequence 
of Theorem 12 .71 and Pronosition 13.21 

Theorem 3.3. The following are equivalent for an element A = (yli, ...,An) G Vn, n>l. 
(i) A G Vn is stable. 

(a) There exists I < j,k,l < n such that {Aj^Ak, A;) e V3 is stable. 
(Hi) There exists ^ < j,k,l < n such that ajk{A) ^ or Ajki{A) ^ 0. 

(iv) A is not similar to an upper triangular n-matrix. 

(v) There is no proper nonzero subspace 0/ preserved by the set {Ai, ...,An}. □ 



4. Irreducibility of representations of finitely generated groups 

We now use the numerical condition for stability found above to derive a similar criterion for 
irreducibility of a representation of a finitely generated group T into G = 5i(2,C). As in the 
introduction, by fixing a set of generators ei, e„ of F, we associate to a representation p : T ^ G 
the point A = {Ai, ...,An) £ Xn given by 

In this section we are therefore dealing with the conjugation action of G = 5*^(2, C) restricted 
to the afHne subvariety Xn = G^" C Vn. For G- invariant functions on Xn, we continue to use the 
same notations described in Definition 12.41 in particular, we still denote by tj (resp. tjk) trace of 
the matrix Aj (resp. AjAk). Because of the standard identities 

tr(BiB2)+tr(SfiB2) = tr(Si)tr(S2) 
tr(S2) = tr2(i?i)-2, 

valid for any two SL{2, C) matrices Bi , i?2, some of those G invariant functions acquire a new form 

'^jk = t] +tl + t% - tjtktjk - 4 = tr{[Aj , Ak]) - 2, 

where [Bi,B2] = -61-62-6^^-62^^ denotes the commutator of two SL{2,C) matrices. 

Recall that a representation p : F ^ G is called irreducible if there are no proper nonzero 
subspaces of which are invariant under p{T). Therefore, if all matrices ^(7), 7 G F are upper 
triangular, p is reducible. In this case, tr([p(/ii), p(/i2)]) = 2 for any ft.1,/12 G F. This condition is 
also sufficient for reducibility as proved in [C!SJ . 

Theorem 4.1. (Culler & Shalen [CSj) A representation p : T ^ G is irreducible if and only if 
tr(c) 7^ 2 for some element c of the commutator subgroup [F, F], 

Making use of Theorem 13.31 we obtain necessary and sufficient conditions for irreducibility, 
depending only on the n-matrix A associated to p, via the fixed choice of generators of F. 
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Theorem 4.2. Let A — (p(ei), p(e„)) G Xn be the n-tuple associated with the representation 
p -.T ^ G. Then, the following sentences are equivalent, 
(i) A G Xn is stable. 

(a) There exists ^ < j,k,l < n such that {p(ej), p{ek), p{ei)) G ^3 is stable. 
(Hi) There exists ^ < i,k,l < n such that ajk{A) ^ or Ajki{A) ^ 0. 

(iv) A is not similar to an upper triangular n-matrix. 

(v) p : T G is irreducible. 

Proof. The equivalence between (i)-(iv) follows easily from the equivalence of (i)-(iv) for the 
S'L(2,C) action on Vn proved in Theorem ESI Let us show that (iv) is equivalent to (v). If 
A ^ UTn there is no subspace of preserved by the set {p(ei), p(e„)}, so p is irreducible. 
Conversely, if A G lATn then, after conjugating p with some g G G, all the matrices p{h), h £ T 
will be upper triangular because the ej are the generators of T. So p is reducible. □ 

This result completes the proof of theorems 11.11 and 11.21 it can be viewed as a sharpening of 
Theorem 14. II fit also generaHzes prop. 1.5.5 of |CS| 1. since part (iii) implies that irreducibility of 
a representation p : F — + G can be verified by computing the values of a finite number (precisely 
(2) + (3) ~ " g"" ) of functions of the n matrices p{ej) € SL{2,C), j = l,...,n. Again, note that 
Theorem 14.21 is true for any algebraically closed field of characteristic 0. 

Above, the criterion for irreducibility is written in terms of conditions for pairs and for triples 
of SL{2,C) matrices. However, when working with representations of a free group F„, the most 
important conditions are the ones for pairs because of the next result, which also shows that the 
condition — can be easily removed in the irreducible case. 

Proposition 4.3. Let p : Fn ^ G be an irreducible representation. Then, there exists a choice of 
generators of Fn such that the corresponding n-matrix satisfies ai2 7^ and vi 7^ 0. 

Proof. First note that choosing a new set of generators of F„ is equivalent to performing an 
automorphism of Fn. Hence, we will find such an automorphism which, upon acting on the n- 
matrix A associated with the irreducible p, will verify (J12 ^ and vx ^ 0. If some (jjk 7^ 
we can just permute the indices to obtain 0-12 7^ 0. So, suppose that all Gju are zero and let 
{Aj,Ak,Ai) be a stable triple, so that A^fe; 7^ 0. Permute the generators again so that the triple 
becomes {Ai,A2,Az) and assume this triple is already in the form (|2.7ll with ei&2C3 7^ and 
6263 + 62C3 = 0. Then, perform the shift automorphism ei £163 of F„, which corresponds to 
Ai ^ A[ = A1A3 and an easy computation shows (T12 1-^ cr'12 ■= rfi&2C3((ii62C3 + (0103 — did3)e2). 
Since none of the factors c?i, 62, 23,62 and as can be zero, the condition 6263 + 62C3 = implies 
that (t[2 7^ 0. Similarly, using the shift automorphism Ai 1-^ A1A2, for some fc e Z, we end up 
with 1^1 7^ 0. □ 

Consider now the stable quotient X^/G, where X^ C Xn is the subset of stable points in 
Xn- As mentioned in the introduction, this is a geometric quotient and has the structure of an 
afHne algebraic variety. Because of the identification between Xn /G and Hom{Fn, G)"'^ /G, where 
Hom{Fn,Gy" is the subset of irreducible representations in Hom{Fn,G), it is not difficult to 
show that Xn /G is nonsingular, and is therefore a complex analytic manifold of dimension 3n — 3 
(see for example [HHI)- Also, when the finitely generated group F — ttiS is the fundamental 
group of a surface S of genus g > 1, the space of conjugacy classes of irreducible representations 
Hom{'iTiS,Gy'^^ /G can be given the structure of a complex manifold (of dimension 6g — 6), and 
this can be interpreted as the space of irreducible flat SL{2,C) bundles on S f [Gu| l. 

In general, when the flnitely generated group F is the fundamental group of a manifold M, it 
is clear that a representation p : F — > G will deflne a flat rank 2 vector bundle Ep over M with 
trivial determinant. If AI is an algebraic variety, one can consider moduli spaces for these bundles, 
and in particular, the moduli spaces of stable and semistable vector bundles on compact Riemann 
surfaces are well known. 

In this context, one might ask what is the relationship between stability of the holomorphic 
vector bundle Ep and the stability of the n-matrix A £ Xn associated with p. This relation is 
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simple in one direction. It is a general fact that if Ep is stable then p is irreducible, so A is stable, 
by what we saw above. However, the converse is not true and there are irreducible representations 
giving rise to unstable vector bundles. An example of such a vector bundle on a genus g > 1 
Riemann surface S is the following. Let L be a degree g — I line bundle whose square is the 
canonical bundle of S. Then the unique (up to isomorphism) indecomposable vector bundle which 
is an extension of the form 

^ L ^ E ^ L-^ ^ 0, 

is associated to an irreducible representation p : niS S'i(2,C). Actually, p is a Schottky 
representation, as it factors through a representation p : Fg ^ G oi a free group of rank g, for a 
certain natural projection mS Fg, and p defines a Schottky group in PSL{2,C) uniformizing S 
(see [fI]). Therefore, the corresponding matrix A is stable, although Ep — E is clearly unstable as 
a vector bundle. Let Hom{TTiS, GY*/G be the space of conjugacy classes of representations p such 
that Ep is a stable vector bundle on S. Since under the map p i-^ Ep, the space Hom{niS, G)'" /G 
is the parameter space for a holomorphic family of vector bundles over S, by a result of Narasimhan 
and Seshadri (see |NS| . Thm. 3), we conclude the following. 

Proposition 4.4. The complement of HomiiriS, G)^*/G inside Hom{niS, Gy^"^ /G is a nonempty 
analytic subset. 

The characterization of this analytic subset in terms of the geometry of S seems to be a difHcult 
open problem. 

5. The Magnus trace map r„ 
In this section, we will study the Magnus trace map T„ defined in the introduction 

A {tl,t2,ti2,t3,ti3,t23, ■■■,tk,tik,t2k, ■■■,t7i,tln:t2n) 

and determine when a given point in C'^"~^ determines a finite (and nonzero) number of orbits of 
the action of G = SL{2,C) on X„ = G^". Recall the definitions H1.2II of ajk and of the Fricke 
discriminant Ajki- One of the results in [M] states that 

Theorem 5.1. (Magnus ^J) Let n > 4 and Ai, A2, A^ £ SL{2, C) be three fixed matrices verifying 
ai2 and A123 7^ 0. Let p = (ii, t2, ^12, ^3, ii3, ^23) G C^. Then given any q G C'^"^^ there exist 
A4, An such that 

Tn{Ai,...,An) = (p,q). 

The number of solutions {A4, An) is bounded by 2"^^. □ 

This result could suggest that the image of T„ does not intersect the sets in the image cor- 
responding to the conditions ai2 = and A123 — 0, as these are defined by polynomials in the 
variables tj and tjk. It turns out that the Fricke discriminant condition is not really necessary, and 
we only need to prevent 0-12 from being zero. 

Theorem 5.2. Let n > 2 and Ai,A2 G SL{2,C) be fixed matrices with ai2 ^ 0, and let r — 

{ti,t2,ti2) . Then given any s e c3ri-6 ^/jg^g gxist A3, ...jAn such that 

Tn{Ai,...,An) = (r,s). 

In proving Theorem 15.21 we will use systematically the transposition invariant forms of a pair 
of matrices Ai,A2 verifying (T12 ^ 0, given in Proposition I2.12| We will also regard elements of 
SL{2,C) as complexified SU{2) matrices, or as complexified quaternions with unit norm, writing 
them in the form 

with 

(5.2) aj,Pj,-fj,Sj eC, and + /3| + 7J + (5| = 1. 
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For matrices in G = 5L(2,C), and using the parameterizations of Aj as in (I5.1|l . the following is 
an immediate consequence of the proof of Pronosition l2.12l 

Proposition 5.3. Let A — (^1,^2) € X2 verify (T12 7^ 0. If vi ^ 0, then A is similar to a pair 
B = {Bi,B2) of the form 

^ ^ . ai +iPi \ Q ^ ( a.2 + il32 iS2 



ai — iPi J ' I iS2 012 — j/32 

with a\+ 01 = \, P2 + 62 — ^ ^2 = ^ 0. In case — and V2 7^ 0, the situation is 
completely analogous switching Bi withB2. Ifvi = V2 = ^, then A is similar to a pair B = {Bi,B2) 
of the form 

^ _ I «! + A iX ^ ^ _ f a2 ~ X iX 



iX ai — A y ' " \ iX Q!2 + A 

with aj = aj = 1 and X^ ^ ^ 0. □ 

To adapt our notation to the trace map r„, let us denote the components of an arbitrary element 
z of the range C'^""'^ by 

(5-3) Z = (Zi, Z2, Z12, Zk,Zik, Z2k, Z„, Zin, Z2„), 



and define 



z? 



2 

CTjfe (z) = z| + 2fc + - ZjZkZjk - 4. 

In this way, given any polynomial p(z) in the coordinates of z, its pullback under T„ will be the same 
polynomial in the variables (ii,t2,ii2, in, ^in, ^2n)- To simplify the notation, we will sometimes 
write these polynomial functions without reference to the variables. Consider the following Zariski 
closed subsets of Xn and of C'^""'^, respectively, 

U12 = {A e X„ : auiA) = 0} 

Zi2 = {z e C3"-3 . = 0}, 

so that Tn{Ui2) = Z12. It is immediate that Theorem 15 . 21 ahove can be restated as 

Theorem 5.4. The algebraic map T„ : X„ \ U12 — > C'^""'^ \ Z12 is surjective for n>2. 

Proof. We need to show that, for any given z as in lj5J-i|l verifying + z| + z^2 ~ ^1^2^12 7^ 4, there 
is a set of n matrices 

such that tr{Aj) = Zj and tr{AjAk) — Zjk, for all coordinates of z. Let us start with the case when 
j/i(z) ^ which means zi ^ ±2 and corresponds under T„ to I'liA) ^ 0. Then, using Proposition 
15.^^1 if there is a solution, there is one in the form 

(5.4) f "^V^' "7. V "^i'^^ 
V ai - y Y zd2 a2 - ip2 

A,^( ^'^2^'^ V fc = 3,...,n. 

V "7fe + *t>fe Uk ~ ipk ) 

Then, we need to solve 

Zfe = 2afe, /c = l,...,n, 

(5.5) zife = tr(yliylfe) 2(aiafc - /3i/3fe), /c = 2,...,n, 
Z2A; = tr(A2Afe) = 2(a2afc - /32/3fc - (524), fc = 3,...,n, 

and an explicit solution is obtained by setting = 2jt/2, for fc = 1, n and 



ZlZfc - izife 



/3i = \/l-ai, /3fe = , /c = 2,...,n. 
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(5.6) S2 = Jq22, 4 = ^, fc = 3,...,n, and 

02 



02 

where we have used the abbreviations qkk — ^ ^ 0k Ijk ~ ctjC^k — Pjh — \zjk, if j ^ k. 
The denominators /3i and 82 are both nonzero because of our assumptions on vi{'z) — —2f3f and 
fi2(z) = — 4/3j(5| = 2v\8\. Observe that, after assuming A\ diagonal and A2 = , the above 
are the only solutions, and different solutions correspond to different choices of square roots in the 
above expressions. Also note that the Fricke discriminant appears as Ai2fc = 16/3j(5|7^. 
When J^i(z) = j^2(z) = 0, from Proposition we may use the parametrization 

where ai and a2 are square roots of 1. Now, the equations Tn{A) = z become 

Zk = 2ak 

(5.8) zife = 2aiafc + 2A(z/3fe - 4) 

Z2fc = 2a2afc + 2A(-i/3fe - 4), A: = 3, n 

which one can easily solve for afe, /3fc, and 4- The variables 7^ are then obtained from the 
normalization 115. 2|l . As before, the solutions in this form will be in finite number. □ 

As remarked, the proof of Theorem 15 .41 imnlies that any point z g C'^"^'^ \ Zi2 determines an 
orbit up to a finite ambiguity. More concretely, we describe all the solutions as follows. 

Theorem 5.5. Lei z e C'^"^'^\Zi2 and A — [Ai, A2, An) he a solution ofTn{A) = z, such that 
Ai and A2 are invariant under transposition. Then T^^{z) is the G orbit of the finite set 

(5.9) {{Ai,A2,B3,...,Bn) : Bk ^ Ak or Bk ^ Al] d 
of cardinality < 2"^^. 

Proof. First, let z g C^"~^ \ Z12 verify zi 7^ ±2, and let Si be the space of solutions of Tn{A) = z 
with Ai diagonal and A2 = A2. From the proof of Theorem Ij5.4ll and from Propoposition (j5.3|l . 
any ^ € 5i is obtained from formulas Ij5.4ll and (I5.6|l , for a certain choice of square roots of /3i , 
62 and 73,..., 7n. Changing all the signs of /3„, 73, 7„ simultaneously, gives a well defined 

map <7i : Si ^ Si. Similarly, let (T2 : 5i ^ Si be the operation of changing simultaneously the 
signs of 4, 4, 73, 7n- The signs of each 7^, k = 3, ...,n can be changed independently of 
the rest, giving maps at ■ Si ^ Si, k = 3, ...,n. For matrices in the form H5.1II . it is clear that 
conjugation by g = (0, i, i, 0) changes the triple of vectors {(3, 7, 6) into (— /3, —7, S), and conjugation 
by 5 = (i,0,0, — i) maps (/3,7,(5) into (/3, — 7, — (5) (naturally any conjugation fixes the vector a). 
Therefore, ai and (72 act trivially on the space Si/G. Since transposition of a single Ak changes 
the sign of a single ■jk, k = 3, ...,n, the orbits are as in H5.9|l . Similarly, to treat the case zi = ±2, 
let So be the space of solutions of T„(A) = z of the form 115. 7|l . H5.8II . As before, define ao : So ^ So 
by changing simultaneously the signs of A,/3i, ...,/3„,(5i, ...,4- By the same reason as before, this 
acts trivially on Sq/G, so also in this case, the set of solutions is given by 115.911 . □ 

We have thus finished the proof of Theorem II .31 
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Appendix A. Reconstruction of matrices from traces 

In this Appendix, we briefly indicate the generic reconstruction of (the SL{2, C) orbit of) general 
n-tuples of 2 X 2 matrices A £ Vn from a minimal number of traces given by the analogous trace 
map 

(A.l) A {tl,tii,t2,t22,tl2,t3,t33,ti3,t23, ■■■,tn,tnn,tln,t2n)- 

The formulas are identical to the ones in Theorem 15. 41 when written only in terms of the functions 
Tjk : C4"-3 ^ C, given by 

Tjk{z) = Zjk - ^ZjZk, j,ke{l,n}, 

except that now we allow coordinates Zjk with j = k and, writing Aj in the form H5.1|l we don't 
require the normalization condition 115.211 . For instance, for (Ti2(z) 7^ 0, and 1^1 (z) ^ 0, the following 
matrices form a solution to Tn{A) = z. 



ai — i(3i y ' \ i&2 ct2 — iP: 

Ak^i '''+_;^' ^'+%' V fc = 3,. 

V -Ik + iOk ak - ipk I 



52 



with 



^2 = xli: , Ok^ -J , ,A: = 3, 

2tii 2d2Tii 



I ^12k , „ 

Ik = \ , fc = 3,...,n, 

V 4cri2 

where the 'Fricke discriminant', as a function of Tjk{z), is given by 

Al2fc(z) = 2{Ti2Tkk + Tlkt22 + T^kTll — 2Tl2TlfeT2fe — TllT22Tfcfc), 

in agreement with Ij2.5|l . The case with zi,Z2 € {—2,2} can be treated similarly. 

Appendix B. Examples with T,7^(z) = 0. 



-•3n-3 



Here, we show that the image of r„, for n > 4, does not contain certain points z G C 
From Theorem l5.2l if the equation T„(A) = z has no solution A G Xn, then (Ti2(z) — 0. Take, for 
example, any z verifying zi = Z2 = z\2 = 2, and for which there are two indices fc, I ^ {1, 2} such 
that 

(B.l) (Zlfc - Zk){z2l - Zl) ^ (zi; - Zl){z2k - Zk). 

Then, without loss of generality A can be taken in the form: 



Aj = ' "^^ , J =3, ...,71. 

Suppose T„(A) — z. Then, we should have, for all j = 3, ...,n, 

Zj = 2aj 

(B.2) zij = 2aj + biCj 

Z2j — 2a j + 62 Cj, 
In the case that 61 and 62 are nonzero, this implies 

Zlk - Zk Z2k - Zk Zll - Zl Z2I - Zl 

Oi 62 Oi 62 
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which is impossible by our hypothesis ljB.l|l . Similarly, if bi — 0, equations ljB.2ll imply zik = Zk 
and zii = zi, contradicting again ljB.l|l . The same happens if 62 = 0. 

More generally, a similar situation occurs in the case that 0-12(2) = but, for example, i^i(z) is 
nonzero. In this case, without loss of generality (see lemma ITsji . we have the parametrization 

ai + iPi 
ai — iPi 



Ax 



V Oi2-i(i2 ) \ aa - z/32 

Assuming A2 non-diagonal, we need to solve the equations, for every A: = 3, ...,n. 

Zk = 2afe 

zife = tr(AiAfe) = 2(aiafe - (3i(3k) 
(B.3) Z2k = tf{A2Ak) = 2{a2ak- f32Pk) + Ck. 



One finds that /3i = \/-^ 7^ 0, /32 = \l and 

2aiak - zik _ rifc(z) 



Pk = 



Ck 



2/3i 2/3i 

/3lT2fc(z) - /32Tlfe(z) 



If Ck 7^ 0, then the b}. can be found using the normalization ot\+ 0^ — b^Ck = 1- However, when 
/3iT2fc(z) = P2Tikiz), for some fc ^ 1,2, in the above expression we obtain Ck = which implies 
that A2 has to be in diagonal form, and then Ck disappears from equation ljB.3ll . so we need to 
have PiT2j{z) = /?2Tij"(z) for all j ^ 1,2. Obviously, this does not hold in general. Note also that 
these computations, combined with the previous case zi — ±2, allows one to reprove surjectivity 
for n = 3 (in this case, C3 = is exactly equivalent to the necessary condition /3iT23(z) — /32Ti3(z)). 
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